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ABSTRACT 

Materials produced following a seminar held on the 
orientation to educational evaluation, conducted for ABE Summer 
Institute directors and allied staff, are provided. This material 
relates to common perspectives for effective evaluation that can 
become part of the evaluation methodology used by the summer 
institute directors. The planning for the two-day instructional 
session, the workshop program, an overview of evaluation, a 
hypothetical evaluation exercise, and material developed are 
presented in the proceedings. Attachments are: (1) Overall Reaction 
to the Evaluation Workshop; (2) Seminar Individual Information Sheet 
(3) Seminar Cognitive Information Inventory; (4) Sample Items 
Developed by Seminar Group — Personal Data Inventory, Participant 
Input, Director Input; and (5) List of Seminar Participants. (DB) 
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MEMORANDUM 



TO: State ABE Directors and Project Staff 

FROM: Regional Staff 

DATE: June 9, 1970 

SUBJECT: Proceedings of the Evaluation Seminar held June 5*6, 1970 in Atlanta, 

Georgia. 

Attached are the proceedings of the orientation to educati ona l evaluation 
which was conducted for institute directors and allied staff as a part of the 
Technical Services Program of the Staff Development Project. Tbi/* Material, 
produced immediately following the June 5th and 6th meeting relates to common 
perspectives for effective ev aluat ion that can become part of the evaluation 
methodology used by the simmer institute directors. 
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Introduction 

Charge to Consultants 

The process and components of institute evaluation have been a con- 
tinuing concern of both the regional project staff, adult education state 
staffs, and project personnel in the participating states. The need for 
a seminar to discuss these concerns had been recognized as a legitimate 
part of the Technical Services Program. 

This need was underlined and emphasized because of the Office of 
Education’s plans for evaluating -project ■activitie&.cand summer /acti- 
vities in our states through their nationwide assessment grants. As a 
result, the regional staff moved rapidly to sponsor an abbreviated s emin ar 
to examine principles and theory of educational program evaluation. A 
two-day program was planned primarily for dir ectors of the 13 summer in- 
stitutes or the person who might be designated by him to conduct evalua- 
tion. State directors were invited to send a member of their staff, as 
was each participating institution, so that maximum utilization of the 
evaluation techniques that were developed would result. 

The program format was drawn f ro m s imilar activities conducted at the 
University of Virginia. Professor Virgil Ward had conducted these more 
extensive programs and was contacted to ascertain if he could bring to 
bear the core of those efforts upon the problems of eval u ation in the 
ABE Institutes. 

Professor Ward indicated that a short program could be developed 
and agreed to act as chief consultant. The limitations of time and pres- 
sure were acknowledged, as the thief consultant in collaboration with 
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Associate Professor Jeff A. lyatte of the University of West Florida, be- 
gan to plan a two-day instructional session. 

The consultants were pleased to accept the opportunity to work with 
the project staff in the light of the following explicit understandings: 

(1) That the maximum results expected to occur from such a short 
session would be an appreciation for the importance of evalua- 
tion and a better acceptance of evaluation responsibilities 

(2) That appreciation for the importance of some concentration on 
the principles and theory of educational program evaluation, 
no matter how hastily concocted, would probably result in some 
degree of improvement in the conduct of evaluation responsi- 
bilities of the respective directors or eval ua tors, over that 
likely otherwise to emerge 

(3) That the suggestive "design" or model and instruments around 
which the orientation experience evolved would be a ckn owledged 
as less than perfect, though hopefully essentially valid 

(4) That the report that emanated from the learning experience he 
confined to an "in-house" paper, summarizing proceedi ng s for 
the convenience of the participants involved, and not for gen- 
eral distribution. 



Rationale 



Within the allowable limits discussed with the regional staff, the 



principal consultant began to conceptualize overall feasibilities for a 
two-day orientation experience in educational progr am evaluation. His 
first move was to ob tain schedule clearance for participation in the 
seminar of a colleague (associate consultant) with wh cm he had worked 



in similar functions. 
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Their first considerations were feasible aspects of training programs 
which could be accomplished within a very short period. The second con- 
siderations were focused on the objectives of the program. The following 
specific points were examined: 

1. Should the training experience evolve around one or more syste- 
matic theoretical models for evaluation? Or should it involve 
an eclectic; synthesis with forseeable direct applicability to 
the ABE institutes? 

2. Should the training experience be developed around general prin- 
ciples and practices of evaluation, or, to the contrary, around 
an illustrative model designed for the purpose of this particular 
orientation? 

3* Should the objective of the orientation he instruction in the 
techniques of program evaluation from which principles and prac- 
tices, each director would design his own evaluation plan, or 
should the orientation program take the form of a preconceived 
plan feasible for actual implementation? 

The resulting deliberations between the consultants and the regional 
staff will be indicated in the description of the workshop program which 
follows. 

In another aspcet of preplanning the consultants, in continuing dis- 
cussions with staff, determined that certain overall characteristics of 
the training experience should prevail: 

1. The training experience should be practical in nature rather than 
theoretical. Such principles as might be needed were to be in- 
cluded in explanations of the practical patterns and techniques 
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2. That all activities within the training program should he made 
explicitly visible with respect to nature and purpose. This 
discipline was to acknowledge that hasty, ad hoc techniques 
drawn tress, the complex matrix of evaluation theory would, at 
best, he imperfect and that sound instructional gains would 
come from explicitly acknowledging these abrogations of valid 
principles and techniques. 

3. That the training program itself should he organized as an 
explicit simulation exercise in educational program evaluation. 
This feature of the program would he an “object lesson" in 
this sense: what was being suggested by way of an eval u ation 
pattern would he recycled into the instructional program through 
the simulation exercise. 

As the third aspect of the rationale, the consultants determined 
principal constraints affecting this training experience: 

1. The severe limits in time necessitated unrefined, though essen- 
tially valid presentations. 

2. The instructional pattern (the presentation of substantive mate- 
rial) should he illustrative of an approach to adult learning 
that all regional institutes could take. 

3* neither the consultants nor institute directors themselves would 
he able to either (a) select and obtain published instruments 
essential to the suggested design, nor (b) construct such in- 
struments to meet c o nv entional , criteria of reliability and vali- 
dity in the time allowed for the seminar. 
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It was thought that carrying through a 'whole plan for evaluation, one 
systematically conceptualized in form and essentially valid in content, 
would supercede the value of imperfect instrumentation, provided that 
the imperfections were recognized and that the impossibility of defini- 
tive inferences and appraisals fTcm such ad hoc instrumentation were 
deeply and pervasively realized. 

Workshop Program 

Perspectives on Evaluation . Preparation for the evaluation task is nec- 
essary to infuse vigor and substance within many educational endeavors. 
Too many educators ere unprepared for the definiteness of the evaluation 
task. An expanded group of professionals in this area is necessary. 

Ibis was a theoretical basis for the evaluation activity that was under- 
taken at this meeting. 

Objectives . Within the constraints indicated above, the following choice 
was made: TO provide an instructional session for the directors in the 

principles of educational evaluation, these principles to be incorporated 
into the form of a cmceptutlized st r uc t u re (plan, d e s i gne r , model) for 
the evaluation of a short term educational or training experience; and 
that this objective would be implemented through two pervasive features 
of the immediate workshop orientation, (a) that the suggestive pattern 
would be made visible, and explained at every step under the invited 
posture for directors to "take or leave", (b) that participant involve- 
ment would be systematically sought, in increasing degree as the two-d??.* 
advanced, the purpose being to familiarize sad to practice the directors 
in constructing the substance within each principal category and feature 
of the Illustrative evaluative model c o mp ri si ng the core of the orienta- 
tion session, (c) that a simulation experience composed of actually 
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rifl ing the pT»r> or design being described as instruction (with instruments 
hastily constructed for the purpose of substantive focus op evaluation, 
not adult education techniques ) would add to the effectiveness of the in- 
structional process. 

Overview of Evaluation . 

Objectives of Evaluation 

1, Among. many purposes, evaluation may he conducted 

1. So improve on-going programs. 

2. So rate one project against others. 

3. So assess the merit of a terminated activity. 

4. So provide counsel for work about to begin. 

5- So provide v alid principles general izable to other similar efforts. . 

6. So record f t ally the story of a particular e du cation a l effort. 

2. Requirements for an Evaluation 

1. An evaluation must be executed according to a systematic plan. 

2. An evaluation must several independent components 

which can he used as internal checks on the final judgm ent ren- . 
dered. 

3* An evaluation plan most in/owte clearly i dent i f ied criterion' 
measures for variables providing basic data for the fin a l judge- 
ment. 

Jj*. An evaluation plan must include clearly identified and clearly 
defined criteria for judgements which provide basic data for the 
final judgement. 

5. An evaluation plan must have clearly defined methods and proce- 
dures for executing the methods. 
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6. An evaluation plan must account for all relevant variables feasi- 
ble under the conditions for the evaluation. 

7. An evaluation plan must provide for periodic assessment and must 
make provisions for modification at any time the results of the 
assessment indicate the need for it. 

8. An evaluation plan must include a provision for reporting re- 
sults in a usable form. 

9* An evaluation plan must be clearly focused on specific objec- 
tives. ✓ 

3. Obe Model 

Definition of Evaluation 

Evaluation : Ihe deliberate act of gathering and processing infor- 

mation according to some rational plan, the purpose of “which is to 
render at *cme point in time a judgement about the worth of that on 
“which the information was collected. 

Elements of the Definition 

1. The object of the evaluation, that which is being evaluated. 

2. 2he agent of the evaluation, that which does the evaluating. 

3* The i n p ut s far the evaluation, the information to be collected. 

4. The plan f or the evaluation, the rational process through which 
the i n p ut s are put. 

9* The time of the evaluation, either formative, summative, or con- 
tinuous. 

6. The ’Wlti-purpose” product of the evaluation, the form which 
the final, judgement takes. 

o 
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The Object of the Evaluation 

The object of the evaluation is that -which is being evaluated, 
that about -which the Judgement is being made. 

The following questions ebout the object are a ppropr i ate: 

What is the nature of the object? 

Is it a learner? Is it a sequence of courses? Is it 
an entire school program? 

Where does the object fit into the str u ct u re of education? 
Is it at the elementary level? Is it at the secondary 
level? Is it at the college level? Is It post*. 
college? 

At what level in governmental organization is the object? 

Is it local, state, regional, national? 

The Agent of the Evaluation 

The agent is the person or body which renders the Judg em e nt . The 
following questions about the agent are ap propr i ate? 

Is the agent a single person, a body of persons, or a com- 
bination? 

Is the agent a student? Is the agent a teacher, a 
principal, a board? Is the agent a legislative com- 
mittee? Is the agent some combination, for example, 
a college president and a legislative committee? 

Where does the agent fit into the structure of ed u c a tion? 

Is the agent above the object in the st r u ct u re? Is 
the agent below- the object? Is the agent at the same 
level as the object? 

Where is the agent in the governmental, organization? 

What staff will the agent be provided? 

What funds will the agent be provided? 

What policies will the agent follow? 

How will the agent evaluate his evaluation? 

Toe Inputs for the Evaluation 

The in p u ts are the elements of information which go into -the ~ 
evaluation plan. They provide the basis upon which the agent 
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renders the judgement about the object of the evaluation. The 
following questions about the inputs are appropriate: 

What will be the source of the inputs? Will it be teachers? 
Students? Principals? Parents? 

Will the inputs be objective (measured), or descriptive (sub 
jective), or a combination? Will they be standardized 
test results? Will they be measures of discrepancies 
between objectives and performance? Will they be the 
results of inventories? 

What will be the instruments for providing the inputs? Will 
they be tests? Inventories? Opinions? 

Will there be a sampling procedure used in providing the 
inputs? 

Will testing be done on a sampling basis? Will opinion be 

sampled? 

Under what conditions will the inputs be provided? 

What will be the schedule for providing the inputs? 

How will the inputs be organized for retrieval and process- 
ing? 



The Han for the Evaluation 

The plan for the evaluation is the rational process through 
which the inputs go before they are translated into bases for 
making the judgement. The following questions about the plan 
are appropriate: 

What are the objectives of the evaluation? (See: Objective 

of Evaluations). 

What is the nature of the inputs? Will there be measures? 
Will there he judgements ? Will there he incidental inputs? 

Mil there he statistical procedures employed? 

For what levels of judgement will information be needed? 

Will the product of the evaluation go to different persons? 

What criteria will he used in rendering the judgement? 

What are the relevant variables involved? 
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What are the criterion variables? 

What analyses will he employed? 

What interpretations will he given the data collected? 

Who will he in charge of data analysis? 

The Time of the Evaluation 

The time of the evaluation has to do with whether the judgement 
will he rendered during the developmental stages, of the object 
of the evaluating at the termination of some phase at which a 
vzdt can he considered to have been accomplished, or continuously. 
Appropriate questions relating to time are: 

Will the evaluation he formative, summative, or continuous? 

Does the time correspond with scheduling de m an d s? 

What is the schedule for the total evaluation? 

The Product of the Evaluation 

The product of the evaluation is the judgement rendered. It is 
the administration of the evaluation. Ap prop ri ate questions 
about the product are: 

At That level will the judgement he made? 

What effect does the judgement have? 

Is it to determine effectiveness? 

Is it to determine resource allocation? 

Is it to determine whether continuation of a program is de- 
sirable? 

Is it to guide in a p prop r i ations of monies? 

What form will the judgement take? 

Will it he a report, a grade, a certificate? 

What means will he used to provide it? 

What alternatives to the object (program, etc.) of the eval- 
uation exist? 




To what audiences will the judgement he disseminated? 

it 
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When will the judgement he rendered? 

Will the judgement he periodically updated or is it fina l? 
Is the judgement a tentative one? 

How critical is the judgement? 

Hypothetical Evaluation Exercise 
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The Example 

Three high school science teachers have w r itt en a programmed instructional 
sequence on the metric system. Their decision to write it was the result 
of their consensus that much time was wasted in science classes going 
over the system for the few students who did not know it. A programmed 
instructional sequence could, if available, he given to only those stu- 
dents who were im-Pmu-n-ifty -with the metric system. It would, therefore, 
add to the time available for topics of greater importance. 

The teachers used -the following plan in writing the programmed 
sequence : 

1. Specification of the terminal skills desired 

2. Construction of frames in format to develop each 

of the skills 

3. Construction of test situations to determine whether the 
skills had been achieved upon completion of the pro- 
grammed sequence. 

The three teachers wanted to try the sequence and render seme 
judgement about its success. They wanted to know specifically: 

1. Did the sequence enable the learner to develop the de- 
sired skills? 

2. If some skill « were not developed, which skills and why? 

3* Was the time taken less than the two hours of class time 
required to cover the skills included in the sequence? 

4. What was the attitude of the students toward the se- 
quence? 



The programmed sequence was tested in the following way: 



1. Students were administered a test consisting of test sit- 
uations selected from those constructed to determine 
whether the desired skills had been developed by the 
program ^ ^ 
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2. Students who failed to reach the 90$ achievement level 
on the items 'were given the programed sequence 

3. 3he beginning time 'was recorded 

4. The ending time 'was recorded 

5. test vas re-administered and scored 

a. Students *w ere asked to e^jresa In writing their 
opinion of the sequence. 

Die teachers found, as they required, 

1. That there was in every case an improvement in the per- 
formance on the test after completion of the programmed 
sequence. 

2. Only 5$ of the demanded 9 0$ of the students failed to 
reach the 90$ level of achievement on the last adminis- 
tration of the test. 

3. Of the skills required, only conversion from one system 
to another was not successfully taught to at least 50$ 
of students. 

4. Die maximum amount of time required to complete the se- 
quence was 90 minutes; the mBsSsma amount of time was 
20 minutes, and the mean time was 32 minutes. 

5. Die girls reacted favorably to the sequence; the boys 
unfavorably. 



Doe metric system, the teachers found, could be taught more efficient- 
ly by using the pro g r am med sequence. They decided that idle sequence 
was highly successful for girls but of questionable success for boys. 
There was a need for revision of the frames or conversion. A new 
sequence was needed for beys. 

Die Analysis of the Example According to the Overview of Evaluation 
Object: The programmed instructional sequence on the metric system 

Agent: Die three science teachers 

Inputs: 1. Scores on test administered prior to sequence 

2. Scores on test administered after sequence 



3. Beginning and ending times 

4. written student opinions 

Objective: Improving ongoing programs 
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Plan : 

1. Improvement was required of all students 

2. 90% of the students were required to achieve 90% on the 
final test 

3. All skills must he taught to at least 50% of the students 

4. The skills must be taught in less than 120 minutes 

Mae : Formative 

Product : Decision 

The programmed sequence is successful but needs minor re- 
vision. 

' Material Developed 



The suggested pattern and process of evaluation took the form of an 
eclectic design. It was mutually agreed that the Illustrative pat- 
terns and developed during the s eminar were only suggestive 

and were by no means representative of finished products that could 
be used by directors for evaluative purposes. The fact was also em- 
phasized that the entire process was suggestive and not mandatory. 

Participants contributed greatly to the model instrumentation 
that evolved from group work sessions. Four areas were iden t ified 
as input categories needed for evaluation: 

1. Feedback from participants 

2. Feedback from directors 
3- Affective information 
4. Congitive information 

Bough samples of these four categories were used during the simulation 
exercise wherein evaluation of the evaluation seminar took place. The 
rough samples mentioned were merely suggestive and served to provoke 
thought on the part of the participants to dsveLqp their own guidelines 
and illustrations of instruments that would meet their evaluation needs 
relative to their summer institutes. To this end the seminar participants 
were grouped to consider inventory items for each of the four categories 
that would meet their particular needs for evaluating their summer insti- 
tutes. 
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Die Inventory items that were developed are included with this material. 
These items are rough and are included to remind the participants of the 
examples they developed. This we hope will help tfcam to focus clearly 
on what their specific instrumentation needs are in light of the seminar 
outcomes. 

The participants indicated that the two-day seminar had been an informa- 
tive and meaningful experience. Their reactions to the overall seminar 
pointed up the fact that the content used during the seminar was very 
relevant and useful; they indicated that the material presented during 
the seminar was well done and they all voiced interest and appreciation 
for the experiences afforded them during the two-days of the seminar. 

Dr. Brown, the director of the SREB ABE project, concluded the s emin a r 
by re-emphasizing the fact that the two-day seminar had been purely de- 
signed as an in s tr u c ti o n al device and that none of the outcomes were in- 
tended to be imposed on the institute directors. The primary hope, he 
stated, was that the seminar would be helpful to the institute directors 
in Improving and impl ementing their evaluation plans for their respec- 
tive summer institutes. 

♦ 

The fact that three re gional consultants will be available to provide 
certain types of assistance through the te chnical assistance p rogra m 
of the project was also emphasized in Dr. Thrown* s remarks. These con- 
sultants, Dr. Jack Blakeman, University of Georgia; Dr. Pearl Gunter, 
Tennessee State University; and Dr. Qnmett Kohler, Mississippi State 
University; may be obtained through requests from institute directors 
to Dr. Brown. 

The seminar was adjourned with the understanding that a follow-up meeting 
with the seminar participants would be held in later summer or early fall 
to dis cu ss fart? t ? evaluation activities and explore the feasibility of 
a regional approach to institute evaluation based cm experiences that 
evolve from subsequent summer institute evaluation activities . 
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Attachments 



1. Overall Reaction to the Evaluation Workshop 

2. Seminar Individual Information Sheet 

3* Seminar Cognitive Information Inventory 
k. Sample Items Developed hy Seminar Group 
Personal Data Inventory 
Participant Input 
Director Input 

5* List of Seminar Participants 
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INSTRUMENTS 0(F EVALUATION' 



Overall Reaction (affective) to the Evaluation Warkshop 



Educational activities are considered more valuable In outcome 
if they yield gains both in understanding and shills (cognitive, be- 
havioral) and in attitudinal and emotional characteristics (affective 
domain). The usefulness of cognitive gains is apparent. The concern 
for affective gains acknowledges that when one is positively affected 
(appreciative, interested) he will try harder to use well what he has 
learned. Certain reactions have been requested to aid in ascert aining 
what has been learned. This terminal reaction is intended to obtain 
tr cm each participant the best possible representation of his introspec- 
tive feelings about the training process. Your careful reac t ion and 
comment will be helpful. The farm is designed to allow quantification 
of responses. 

In comparison to the attitudes and expectations with which I came, 
idle workshop in total effect served 

( ) to increase my interest and appr eciation for e duc a t i o nal evalu- 

ation 

( ) to affect my interest and appreciation but slightly either way 

( ) to decrease interest and appreciation 

The workshop leaders in my opinion 

( ) were satisfactorily aware of the feelirgs of the group and 

Individuals 

( ) were largely insensitive to the "human factor" 

( ) were somewhere between these two extremes 

Msr own efforts to maintain good affect in nrv workshop are likely 
to be 

( ) distinctly superior to ' those here 

( ) about as effective as these, give or take a bit 

( ) perhaps a little less effective on the whole 
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Altogether: 

( ) I liked the experience more than 1 disliked it 

( ) I disliked the eaqperience more than I liked it 

Garment: S ummary Reaction • • • 
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Individual Information 



Workshop H6. 



Sex; ( )M ( )? 
Age; ( )Pnder 30 ( 



Educational 



«« > -* 



rience: 



( ) Under h years 



)31-**0 C )to or over 
(teaching, supervision, administration) 
( )2t-10 years ( )11 or more 



Professional Training: Highest Degree Earned 
( )AB ( )MEL8ter's ( ) Doctoral 



Please check one statement in each group below 

( ) I know very little about systematic educational program evalua- 

tion — never had & course, never attended an in-service tr a i ning 
session. 

( ) 1 have had some training, and done some reading, to the point of 

at least elementary waderstanding about the theory, d e s i g n and 
techniques of evaluation. 

( ) I have had seme research training (testing, statistics, methodo- 

logy), with incidental hearing on evaluation, and can count on 
considerable transfer value. 



( ) Frankly, my attitudes are rattier negativistic ; I doubt the value 

of what we can or will do in these two-days. 

( ) I'm willing, hut not overly enthusiastic or optimistic about 

the value of this orientation session. 

( ) I’m enthusiastic. I need anything I can get on the subject. 
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Cognitive Information 



PART I 



1. As a process, evaluation almost always involves 

a. comparisons of control and eaperiemental groups 

b. cccpariscns-of beginning and ending status 

c. contrasts between low achievers and high 

d. contrasts between two different ways of achieving 
objectives (at least two ways) 

2. Which of the following activities is least "evaluative” in nature? 

a. the merit rating of teachers 

b. the awarding of athletic scholarships 

c. the classroom teacher's test 

d. the estimation of which of two football teams will win 

e. deciding which horse to bet on 

3* In assuring the effectiveness of an activity, one of the following 
is a more fundamental requirement than others. 

Which? 

a. that anticipated outcomes predetermine objectives 

b. that objectives be envisioned in terms of outcomes 

c. that procedures be commensurate with processes 

d. that objectives and processes be efficiently related 

to anticipated outcomes 

4. The most distinctive feature of evaluation among the following is: 

a. insistence that an external judge must observe and 

assign worth 

b. Insistence that pre-and post-measures be system- 

atically incorporated into the design 

c. insistence that the purpose or objective of the 

thing to be evaluated is clearly spelled out 

d. insistence that norms be validated well in 

advance 

5. The principal purpose of the contemporary eva lu at i on movement is: 
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a. to assess student achievement more validly 

b. to i mpro ve the process through* which we develop textbooks and 

TAjwMng aids 

c. to ascertain whether the purposes of a given activity 

were carried out _ 

20 
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6. Evaluation differs from measurement in that 

a. evaluation may incorporate measurement 

b. evaluation involves judgement 

c. evaluation may apply to phenomena that cannot he 
measured (precisely) 

d. all of the above 

7- A good evaluator 

a. most believe in the significance of the pro- 
duct or activity he is evaluating 

b. must be as neutral as possible with respect to 
what he is evaluating 

c. must form judgements as to the significance of 
an activity according to how effectively it is 
carried out 

d. must appraise an activity accurately regardless 
of how insignificant it may be 

8* Evaluation differs from research in 

a. objective or purpose 

b. procedure and technique 

c. setting or context 

d. all of the above 

e. none of the above (that is research and evaluation 
do not differ essentially in any of these respects) 

9- Evaluation as a concept implies 

a. ascertaining the worth of something 

b. comparing something with something else 

c. ascertaining differences and similarities among 
several- simil ar activities or products 

d. making decisions about what activity would be 
most wor th y 

10. The broadest purpose underlying evaluation activity is 

a. to aid in meeting educational responsibilities 

b. to aid in ascertaining greatest economy in edu- 
cational progr am s 

c. to aid in learning more about planning educa- 
tional programs 

d. to aid in meeting individual differences among 
learners 
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PART n 



1. Write out a definition of evaluation. 



/ 

2. (a) A definition of evaluation includes elements. For example, 

the thing •which is being evaluated is an e le m ent of a defini- 
tion cf evaluation you just gave, list as many elements as you 
can. 

(b) Beside each element, explain very briefly what it means . 



3. A good evaluation should meet a set of predetermined criteria. It 
should, for example, have clearly defined objectives. List as many 
such requirements for an evaluation as you are able. 
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4. Given the following description of a hypothetical evaluation, identify 
in it the elements which you have listed. 

Bor an evaluation of their high school physics 
course a group of high school science teachers 
collected: 

■S 

1. grades in high school physics 

2. grades in other science courses 

3* scores on a standardized physics test 

4. complaints from students about physics 

The teachers collected this information at the 
conclusion of the physics course. If the grades 
in physics corresponded to the grades in other 
science courses, if scores on the standardized 
test were high, and if complaints about physics 
were few, they agreed, the physics course would 
be fudged successful. Otherwise, the course 
would be judged to he in need of revision. On 
the basis of the information collected, the 
teachers decided that the physics course was suc- 
cessful. 



Guideline for personal data inventory on participants 

Age 

Sex 

Educational Badsground 

Area of Major Preparation 

Experience in ABE Programs 

Geographical Location 

Bull- time or Part-time 

Status (directors, principals, teachers) 
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PARTICI2AHT FEEDBACK 



A=Agree D=Disagree K=Not applicable 



A 


D 


N 


1. 


A 


D 


N 


2. 


A 


D 


Hr 


3. 


A 


V 


E 


4. 


A 


D 


E 


5. 


Purposes : 




A 


D 


E 


1. 


A 


D 


E 


2. 


A 


D 


E 


3- 


A 


D 


E 


4. 


A 


V 


E 


5. 


Program: 


• 

• 




A 


D 


E 


1. 


A 


D 


E 


2. 


A 


D 


E 


3. 


A 


D 


E 


4. 


A 


D 


E 


5. 


A 


D 


E 


6. 



purposes. 

4. Hie accomodations for the participants were adequate. 

The instructional media was adequate (audio-visual ait 
etc.) 



of the participants. 

The purposes of the institute were clearly defi 
participants . 

3. The purposes of the institute were implemented. 

Hie participants had an opportunity to contrilnr 
development of the content of the institute. 

Adequate lines of communication were establishet 
staff and participants. 



A D E 1. Hie content of the institute was relevant . 

Hie program was in harmony with the stated 
the institute. 
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A D N 7. The program did effect aa attitude of group cohesiveness. 

A D N 8. Adequate time was available for the purposes of the insti- 

tute to he realized. * 



A D N 9. My performance as an ABE teacher has been enchanced as a 

result of attending this institute. 



A D K 10. The institute was held at a convenient time for the par- 
ticipants. 



o 
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AN EVALUATIVE 
INSTRUMENT 
FOR 

DIRECTOR 
AND 
STAFF 
OF ABE 
INSTITUTE 
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I. Object 

Who determined the purpose of the workshop? 

Participants role 
State Department 
Combinations 

What Is the general purpose: 



What are the specific objectives? 



How are desires finally accomodated? 



How were the r ol es of the director decided? Who is the director? Why 
was he chosen? 



U. Inputs 

A. Wfere facilities adequate? Did they aid the accomplishment of the 
objectives? 



parking 
food 
housing 
off -hours 

.‘adequacy' of Uxob usage dur i ng the institute 
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B. Barticipants 



T4io attended? 

“What characteristics of the group are evident? 



How were unique value patterns accomodated or not acco m o da ted? 



Who attended who determined who could attend? 



C. Materials 

What was used? 



Was it used effectively? 



What other ways can they “be used? 



D. Staff 

Was the staff adequate for the institutes purposes? 
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Were they able to make adjustments to fit circumstances? 



E. Financing 

What is the per unit cost? 



How was the budget developed? 



What are the different sources of p rov i ding f in a n ci ng for insti- 
tutes? 



17, Who composed the planning gr ou p for the institutes? 



To what degree were participants and consultants included in the 
pi ftnrrf ng process? 



How are state-wide needs and developments served by the institute? 



How well are those involved knowledgeable of the tentative nature 
of funding for ABE Institutes due to federal process? 
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V. Time 



Weis the time devoted to the planning of 
How long? 



the Institute adequate? 

1. Less than 2 months 

2. 2-4 months 

3. 4-6 months 



What Is a desirable timetable after your experience? 



VI. Product 

Did your affective and cognitive evaluations Show that expected 
accomplishments were realistic, adequate, etc.? 



Have later follow-ups beyond the dose of the institute been p l anne d 
for? 




Items for Securing Participant Inputs 

1. Content 

a. Appropr i ate In ap p r opr i ate 

(Comments) 

Why did you rate it in this manner? 

b. Useful Hot useful 



(Ocaiments) 

Why did you rate it in tails manner? 
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2. Presentation 

a. Effective Ineffective 



(Comments) 

Why did yon rate it in this manner? 

3. Usage Areas 
Content 

a. Inap pro p r i ate — Modify to bring heme point 

b. Useful — May have misjudged to get andi en ces 
Presentation 

a. Media preference 

b. Feedback to presenter 

c. May be ab le to re-cycle rh-n-tng institute for different . me dia 
Terminal 
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EVALUATION SEKERAR BARUCXEARTS 



June 5-6> 2.970 



Dr. Hilton Bonniwell 
Project Coordinator 


Georgia Southern College 
Statesboro 


Miss Bally Claiborne 
Sapervlsar 


Georgia State Department 
of Education, Atlanta 


Mr. Allen Code 
Project Coordinator 


South Carolina State College 
Orangeburg 


Dr. Donnie Dutton 
Project Coordinator 


Memphis State University 
Memphis 


Mr. Lake Easter 
Supervisor 


Tennessee State Department 
of Education, Nashville 


Dr. James Farrell 
Project Coordinator 


Tennessee State University 
HashviHe 


Mr. Bill Fowler 
Graduate Student 


University of Tennessee 
Knoxville 


Mrs. Flora Fowler 
Graduate Student 


University of Tennessee 
Knoxville 


Dr. Harry Frank 
Project Coordinator 


Auburn University 
Auburn 


Mr. Leon Hornsby 
Supervisor 


Alabama State Department 
of Education, Montgomery 


Dr. Arthur Madry 
Project Coordinator 


Florida A & M • * 
Tallahassee 


Mr. Robert Marshall 
Project Coordinator 


Albany State College 
Albany 


Mrs. Vivian Morris 
Project Director 


Alabama A & M 
Huntsville 


Dr. Marshall Morrison 
Project Coordinator 


Alabama State University 
Montgomery 
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EVALUATION SEMINAR BARTICIEANTS 
Jane 5-6* 1970 



Dr. Hilton Bonniwell 
Project Coordinator 


Georgia Southern College 
Statesboro 


Miss Polly Claiborne 
Supervisor 


Georgia State Department 
of Education, Atlanta 


Mr. Alien Code 
Project Coordinator 


South Carolina State College 
Orangeburg 


Dr. Donnie Dutton 
Project Coordinator 


Memphis State University 
Memphis 


Mr. Poke Easter 
Supervisor 


Tennessee State Department 
of Education, Nashville 


Dr. James Farrell 
Project Coordinator 


Tennessee State University 
Nashville 


Mr. Bill Fowler 
Graduate St.ident 


University of Tennessee 
Knoxville 


Mrs. Flora Fowler 
Graduate Student 


University of Tennessee 
Knoxville 


Dr. Harry Frank 
Project Coordinator 


Auburn University 
Auburn 


Mr. Leon Homsby 
Supervisor 


Alabama State Department 
of Education, Montgomery 


Dr. Arthur Madry 
Project Coordinator 


Florida A & M • • 
Tallahassee 


Mr. Robert Marshall 
Project Coordinator 


Albany State College 
Albany 


Mrs. Vivian Morris 
Project Director 


Alabama A & M 
Huntsville 


Dr. Marshall Morrison 
Project Coordinator 


Alabama State University 
Montgcmeiy 
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Mrs. Kathryn Mosley 
Project Coordinator 



Jackson State College 
Jackson 



Mr. Tom Sills 



West Georgia College, Carrollton 



Mr. William Smith 



Ur. Robert Snyder 
Project Coordinator 



South Carolina State Department 
of Education, Columbia 

Uhive *r 4 vy of South Car olina 
Columbi * 



REGIONAL CONSULTANTS: 



Dr. Jack Blakeman 



University of Georgia, Athens 



Dr. Pearl Gunter 



Tennessee State University 
Nashville 



Dr. Emmett Kohler 



Mississippi State University 
State College 



SREB STAFF: 



Dr. Edward Brown 
Project r-D:Coor 



Adult Basic Education Project 
Atlanta 



Dr. Charles E. Kozoll 
Associate Director 



Adult Basic Education Project 
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Dr. Preston Torrence 
Associate Director 



Adult Basic Education Project 
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CONSULTANTS: 



Dr. Jeff pyatte 



University of West Florida 
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Dr. Virgil Ward 



University of Virginia 
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